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riable optimal control. An algorithm is developed to select 
a set of weighting matrix element such that the conventional 
transient response criteria are satisfied. 

General properties of the optimal system in terms of 
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I. INTRODUCTION 


A. BACKGROUND 


For more than two decades, the need to solve control 
problems in aerospace application has been the primary 
driving force behind the modern control theory development. 
Problems in manoeuvring, guidance and tracking of aircrafts 
and space vehicles have motivated the development of various 
control design and synthesis methods. One of the methods, 
the so-called Linear Quadratic Control or LQ-control 
{Refs. 1,2] has been widely used and is treated extensively 
in the control literatures. Unlike most classical methods 
where the design are based on conventional time response 
criteria, the LQ theory treats the problem of designing 
controllers as that of minimizing a quadratic cost function 
of states and control inputs. The design problems become 
that of selecting suitable weighting matrices in the 
performance index. Two questions naturally arise from this 
method. First, how does one select the weighting matrices 
and second, once a set weighting matrices is selected, how 
does one know that it is a good design. There are generally 
two approaches to the first problem; the obvious one is to 
rely on physical arguments and a certain amount of trial and 
error [Refs. 3,4] Unfortunately, such formulation can be 
obtained in only a few cases. Reference 4 provides a few 
guidelines that can be employed. The second approach is to 
avoid the physical aspect of the performance index but 
instead try to relate the weighting matrices with some other 
performance specification. For example, Tyler and Tuteur 
{Ref. 5] expressed the characteristic polynomial as an 


explicit function of the weighting matrices for single input 


11 


a 


f 


a 


ne 
2 


a 
| 


crs, 
a FP 


ae, 


Single output (SISO) system with diagonal weighting 
elements. Root-Locus type of procedure were used to show 
how the variation in weighting elements affect the eigenva- 
lues of the closed-loop system. Similar relations were 
explored in [Refs. 6,7] in which more general expressions 
were obtained. Their uses were restricted to single input 
case due to difficulty in handling polynomial matrices. 
Solheim [Ref. 8] later developed a sequential design proce- 
dure based on diagonalized (decoupled) system. More recent 
results of eigenvalue placement in optimal control problem 
are presented in [Refs. 9,10,11,12]. 

The second issue of LQ design, i.e., whether a good 
design has been obtained once the performance index has been 
fixed, is related to the multivariable nature of system. 
Unlike the single input case where the closed-loop eigenva- 
lues uniquely define the feedback gain and hence the 
weighting matrices, the MIMO structure provides additional 
dimension which allows further tradeoff for properties other 
than the closed-loop eigenvalue location. An example is the 
gain and phase margin, or in MIMO case, the so-called 
robustness criteria. Robust-control has been the subject of 
extensive researches in recent years and results relating to 
optimal control can be found in [Refs. 13,14,15]. 

It becomes evident from the above discussion that LQ 
control design and synthesis are not just a matter of speci- 
fying performance index. Optimal in the sense of satisfying 
performance index and perhaps pole location does not neces- 
Sary means that a good design has’ been obtained. Other 
criteria like disturbance rejection, robustness and sensi- 
tivity need to be considered and incorporated in the design 
procedure. This is the motivation behind our present 
research which in turn leads to the development of the 


synthesis package. An overview of the thesis is described 
in the next section. 


T2 


B. OVERVIEW 


In this section an c erview of the thesis is given. A 
background of multivariable optimal control theory in terms 
of its structure, frequency domain characteristic and asymp- 
totic properties is first discussed together with derivation 
of some useful relationships in Chapter 2. General robust- 
ness concepts and its application in Linear Quadratic (LQ) 
Control is presented in Chapter 3. In Chapter 4, a computer 
aided design package for pole-placement synthesis based on 
numerical optimization technique is presented. This package 
provides a useful computational tool to support the material 
in the remaining chapter. A step-by-step pole-placement 
synthesis procedure is also presented to illustrate how the 
package can be used to design optimal control system that 
meet time response criteria and other properties. The use of 
the pole-placement synthesis package in two actual design 
problems is demonstrated in Chapter 5. Results in terms of 


frequency and time response properties ,robustness (singular 


value decomposition) are compared to those obtained by other 
design methods. Program listings and an example of a design 
session are included in the Appendix. 


II. MULTIVARIABLE LINEAR QUADRATIC CONTROL 


In this Chapter a brief review of Multivariable Linear 
Quadratic Control theory is presented. Structure of LQ 
system is first given, general stability properties are then 
discussed. In section two the general pole assignment 
problem is formulated for the MIMO state feedback system. 
Interpretation of the state and control input weighting 
matrices and their effect on the closed-loop time response 


behaviors and the asymptotic properties are presented. 


A. LINEAR QUADRATIC SYSTEM 


Consider the following linear time-invariant state-space 
system given by the equations: 


x(t) Ax(t) + Bu(t) (eqn 2.1) 


y(t) Cx(t) (eqn 2.2) 
where x(t) is the n-dimensional state vector, u(t) is the 
m-dimensional control vector and y(t) is the p-dimensional 
output vector. A ,B and C are real constant matrices of 
dimension nxn, nxm and pxn respectively. Assuming that they - 
form a controllable pair(A,B) and an observable pair(A,C), 
the optimal feedback control law is obtained by minimizing 
the following quadratic performance index. 


Q 
u 


fe «] 
J (x'Qx + e ulR u)dt (eqn 2.3) 
0 


where R is positive definite (R>0) for bounded input and pe 


is a scalar. Q is a semi-positive definite matrix (Q20). 
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When both Q and R are diagonal matrices, oe defines the 
relative weight between the state and control weighting 
matrices in the performance index. The quadratic form x'Qx 
and u’Ru provide a weighted measure of the magnitude of the 
states and control vector respectively. The steady state 
control law that minimizes J is given by, 


u(t) = -Fx(t) (eqn 2.4) 


where F is the feedback gain matrix which is given by 
“17 
F = -R BP (eqn 2.5) 


The positive definite matrix P is given by the solution to 
the steady state Riccati equation. 


PA + A’P + Q - PBR B'P = 0 (eqn 2.6) 


Equation 2.5 and 2.6 are well-known results in optimal 
control theory that yield the optimal closed-loop system 


x(t) = [A + BF]x(t) (eqn 2.7) 


whose closed-loop poles are given by the eigenvalues of the 
matrix [A+BF]. The LQ system given by equations 2.1 through 
2.6 is closed-loop stable and can be represented by the 


feedback configuration in both the time and frequency domain 
as shown in Figure 2.1 


15 


Frequency Domain 
uU x x 


Time Domain 


Figure 2.1 State Feedback System-Time and Frequency Domain. 
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In Figure 2.1, if the loop is broken at the input (X) as 
shown, the loop transfer function is given by 


G(s) = F(sI - A)'B (eqn 2.8) 


The matrix [I + G(s)] is called the Return Difference Matrix 
and will be shown to have some important feedback properties 
in the following section. 


B. POLE ASSIGNMENT PROBLEM 


In the most’ general form, the state feedback pole 
assignment problem in control system design can be formu- 
lated precisely as follows: 


"Given real matrices (A,B) of order (nxn, mnxm)  respec- 
tively and a set of n complex numbers (A,,A,,...A, ) closed 
under complex conjugation. Find a real mxn matrix F such 
that the eigenvalues of [A+BF] areA;, i = 1, 2,3... n." 


In general, the closed-loop eigenvalues of (A+BF) can be 
arbitrary located in the complex plane, with the only 
restriction that complex characteristic eigenvalues must 
occur in complex conjugate pair. In other words, if the 
matrices (A,B) are a completely controllable pair, the 
stability of the system can always be improved by state 
feedback. If the (A,B) pair is not completely controllable, 
then the system is required to be 'stabilizeable' meaning 
that in its controlability canonical form given by equation 
2.9 below, the matrix Agz iS asymptotically stable or any 
unstable subspace of equation 2.9 is also in the 
controllable subspace. 


Se a we ie 
MEL Se ee Tb Seat See we eg! apt ane es, 


x, (t) vo A, x,(t) B naps 8) 
x,(t)} | 0  Anl |x,(t)] [0 }ju,(t) 
(eqn 2.9) 


The solution to the pole assignment problem in the 
single input (m=1) case, when it exits, can be shown to be 
unique. In the multiple input case (l<m<n), the solution of 
the so-called inverse eigenvalue problem is, in general, 
undetermined with many degrees of freedom. Additional 
conditions must be supplied in order to eliminate the extra 
degrees of freedom. This has been an area of active 
research in recent years anda number of approaches have 
been developed to relate the extra degrees of freedom with . 
properties such as system eigenvectors, transmission zeros 
and robustness [Refs. 16,17]. In this work, it is shown 
that Linear Quadratic formulation incorporating equation 2.3 
will partly remove the uncertainty that exists in the 
multiple inputs case. It will be shown that useful proper- 
ties like robustness are guaranteed. It is also shown that 
the LQ type of pole placement formulation, when combined 
with eigenvectors assignment type of formulation, will 
produce some very useful design and synthesis procedures. 
In the present work, however, only the LQ eigenvalue place- 
ment problem is addressed; the problem of combined eigen- 
value and eigenvector assignment is briefly described in 
Chapter 5. 
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C. WEIGHTING MATRICES AND SYSTEM PERFORMANCES 


This section briefly reviews the effect of weighting 
matrices on system performance. The physical aspects of the 
weighting matrix for both single and multiple input systems 


arr 


are presented first together with some discussion on the 
asymptotic behavior of the LQ system. 

It was shown in the last section that under complete 
controllable conditions, the time-invariant linear system 
can be stabilized by a linear feedback control law. For the 
regulator-type problem where the aim is to bring the system 
from an arbitrary initial state to the zero state, the 
closed loop poles can be chosen far to the left on the 
complex plane. Convergence to the zero state is fast but 
the large input required may not be practical. This natu- 
rally leads to an optimization problem where’ the trade off 
is between speed of convergence to zero and the magnitude of 
the input. This is reflected in the two quadratic terms in 
the performance index. The quantity x" Qx in the first term 
of the performance index is a measure of the extent in which 
the state at time t deviates from the zero state. The 
matrix Q determines how much weight is attached to each of 
the component of the state. The integral J (x™Qx)dt is a 
criteria for the cumulative deviation of x(t) from the zero 
state during the interval. 

The problem of large control input is resolved by 
incooperating the second quadratic term, J(uTRu)dt. Larger 
value in the element of the control weighting matrix R will 
result in smaller input. It will be shown later that one can 
manipulate R to achieve some secondary design objectives. 
The remaining parameter pep , that meed to be specified, 
accounts for the relative weighting between the state and 
the control inputs. Selecting optimal value for p depends 


on the particular problem and the design requirement. AS p 
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decreases, the integrated square regulating error decreases 
but the integrated square input increases. Very often, the 
optimal control problem is solved for many different values 
of p ., A graph similar to that shown in figure 2.2 is 
obtained where the integrated square regulating error is 
plotted versus the integrated square input. An appropriate 
value of p is then selected to give sufficiently small 
regulator error without excessively large input. 
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Integrated Regulator Error 


Figure 2.2 Selecting Relative Weighting Parameter p. 
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The special case where p approaches zero ,the so-called 


asymptotic properties, has been shown to provide good 
insight for LQ control system design. Some of the results 
from [Refs. 4,18] are summarized below. 

As p decreases to zero for the system given by equa- 
tions 2.1 through 2.6, some ( say q ) of the closed-loop 
poles go to infinity while other ( n-q ) stay finite. Those 
remaining finite approach the left half plane zero of 
det[B'(-sI-A’)~'Q (sI-A)~'B]. If m is the dimension of the 
input vector, then at least m closed-loop poles approaches 
infinity. All closed-loop poles that go to infinity do so 
by grouping into several Butterworth patterns of different 
order and radii. For p approaching infinity, the closed- 
loop poles approach the mirror image of the plant open-loop 
poles. To illustrate the asymptotic concept, two examples 
from [Ref. 4] are given below. 

An example of the asymptotic properties of a_ single 
input system is shown in Figure 2.3 . The closed-loop poles 
of a position control system using LQ type feedback are 
plotted as a function of p . The system has two open-loop 
poles at -4.6 and 0.0. As pe decreases, the closed-loop 
poles go to infinity along two straight lines that make an 
angle of ™/&4 with the negative real axis. AS Pp 
approaches infinity, both closed-loop poles first meet on 
the negative real axis and then approach the open-loop 
poles at (-4.6, 0). 

Figure 2.4 shows the asymptotic loci of the closed-loop 
poles for a multiple input system where n=4 and m=2. There 
are four open-loop poles at (-0.006123, +j0.09353) and 
(-1.250, +£j1.394) and both the state and control weighting 
matrices are taken to be of a diagonal form. As Pp 
approaches to zero, one closed-loop pole stay finite at 
-1.002. The remaining three go to infinity, two of which 


assume a second order Butterworth pattern and the last one 
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approaches on the negative real axis. When p approaches 
infinity, all closed-loop poles approach the open-loop 
poles. 

Many researchers have explored this asymptotic proper- 
ties. Stein [Refs. 9,10] developed a procedure to select 
the control weighting matrices for a desired closed-loop 
asymptotic eigenstructure. It will be shown in the subseq- 
uent Chapters that the asymptotic properties provide useful 
guideline for the design procedures to be described. 


p=000002 


Figure 2.3 Single Input Asymptotic Root Loci. 
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III. ROBUSTNESS THEORY AND LINEAR QUADRATIC CONTROL 


In the last Chapter, the effect of weighting matrices on 
the closed-loop pole of the LQ system was discussed. This 
Chapter addresses yet another important feedback property 
that control system desizners are concerned with: 
Robustness. Robustness theory was developed when it was 
realized that the classical single loop Nyquist test was not 
adequate to guarantee stability when the multivariable open 


loop plant deviates from its model due to a variety of 


reasons [Ref. 15]. In the following section , the concept 
of robust design for both SISO and MIMO general feedback 
system is reviewed. The Singular value analysis is 


discussed in term of multiplicative type of disturbances. 
Finally, robustness for linear quadratic state feedback are 
presented in terms of the effect of weighting matrices on 


the singular value curve. 


A. ROBUSTNESS CONCEPTS 


The concept of robustness for SISO system can. best be 
described in terms of the definition of phase and gain 
margin. A system characterized by good gain and phase 
margin implies that changes in the plant model parameters 
and changes in the loop gain and/or phase may be accommo- 
dated without loss of stability. The gain and phase margins 
of a SISO system are defined with reference to the perturbed 
system in Figure 3.1 

Assuming that the unperturbed system (1(jw)=1) is 
stable, the positive (or negative) phase margin is the value 
of greater (or less) than zero at which the perturbed 


system with l(jw) = k*exp(je) becomes unstable. The upward 
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Figure 3.1 The Perturbed SISO System. 


(or downward) gain margin is the smallest (or greatest) 
value of 1(jw)=k=constant, for which the system become 
unstable. With reference to the classical Nyquist plot in 


Figure 3.2 , gain and phase margin are defined as, 
GM { (upward) = 1/k, GM | (downward) = 1/k, 


- PM* = a, PM ~ = a@ 


a ww 


A set of minimum guaranteed GM and PM may be obtained by 
defining %= min[{1 + g(jw)] as shown in Figure 3.3 where, 


~ 
Q 
<x 
" 


1/(1 + 4%) 


and 


: PM = tcos ( 1- 7/2) 


| 


Figure 3,2 The Nyquist Plot - Gain and Phase Margin. 


ie Sy a gE eG SESE ea RS = 


: Note that in the above definition of GM and PM, either 
@ 'or' Kj; is allowed to change in the loop. The allowed 

changes are therefore very restrictive. A more useful defi- 

nition of the gain and phase margin for MIMO system that 

.- accounts for simultaneous changes in both ®%, and/or K; (the 
so-called universal gain and phase margin) has been derived 

in [Ref. 19]. From Figure 3.3 it can be seen that ag may 

provide a rather conservative estimate of the actual gain 


and phase margin. 


~ Figure 3.3 The Minimum Guaranteed GM and PM. 
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In MIMO system, gain and phase margin characterize the 
ability of the system to tolerate gain and/or phase changes 


within all loops’ simultaneously. Figure 3.4 shows a 
perturbed MIMO system with the assumption that L(jw) = Dia(l, 
(jw),1,(jiw)...). As in the SISO case, the system will 
remain stable as longer as 1; (jw) satisfy GM|< k; < cmf 
(assuming that ®,S are zero ). For the case when the 
magnitude of 1l(jw) are constant, the system will remain 


stable for all ¢.s that satisfy PM~< ®;< PM, 


Figure 3.4 The Perturbed MIMO System. 
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The set of minimum guaranteed multivariable gain and 
phase margins are determined by the minimum singular value 
(¢) of the return difference matrix [I + G(s)], where G(s) 
is the open loop transfer matrix and consists of the plant 
and its controller. Note the similarity between the SISO 
and MIMO cases, 


a, : nearness of (1 + g(s)) to the origin. 


a: nearness of matrix (I + G(s)] to singularity. 


Two important results that are related to multivariable 
phase and gain margin developed in [Ref. 15] are next 
presented as a theorem. 


THEOREM: The multiplicative perturbed system (Figure 
3.4) is stable if either of the following conditions hold: 


e 
q 


@{l+G(s)] > *[L~ (s) - 1] (eqn 3.1) 


iS) 
ro) 


{tr +o (s)] > *{b (s) - I] (eqn 3.2) 


where ¢, o denote the maximum and minimum singular values - 
of (1+G(s)] respectively. 


It will be shown that condition 1 can be related to the 
optimality condition of LQ system and hence provides a 


useful relationship between the weighting matrices and 
robustness. 
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. B. ROBUSTNESS IN LQ SYSTEM 


Robustness properties pertaining to LQ system are 
closely related to the frequency domain optimality condi- 
tion. For the SISO case, Kalman [Ref. 1] showed that the 


return difference transfer function satisfies the inequality 
Ci * gGw) ) 2:1 (4,21) (eqn 3.3) 


Inspection of the Nyquist diagram in Figure 3.5 clearly 
indicates that a SISO LQ state feedback has a guaranteed 
infinite upward gain margin , 0.5 downward gain margin and a 
minimum phase margin of + 60 deg. 


Figure 3.5 SISO LQ Nyquist. 
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" In a similar manner, multivariable stability margin can 
i be derived from the multivariable version of condition 1 in 
equation 3.1 ; 


[1 +G(s)]" R [1 + G(s)] >R fies cigs 


where 
G(s) = R'B'P[sI - A] 'B 


and P 2 0 satisfies the steady state Riccati equation. 
It can be shown that condition 1 in equation 3.1 above 


can be written as 

oe [I + R26 (jw) ny =. (eqn 3.5) 
which can be reduced to 

e{I + G(jw)] > 1 (eqn 3.6) 


where Ris diagonal ( i.e. R = pI _ for some positive 
scalar pe). Like the SISO case, the multivariable LQ regu- 
rs lator with loop transfer matrix G(s) that satisfies equation 
; 3.5 and 3.6 has, in all the feedback loops, a guaranteed 


minimum gain and phase margin given by, 
GM = 1/2, and PM = +60 deg 


The case when R is not diagonal is interesting as 
condition 3.6 no longer apply and additional trade-off can 


be obtained by including off diagonal terms in the control 


input weighting matrix. This is especially useful when the 
nature and structure of the disturbances are known. Design 
involving the off diagonal R matrix will be shown in 
Appendix A. 
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IV. DESIGN PROCEDURE 


A. GENERAL 


The background material described in Chapter 2 and 3 are 
the basis for developing a computer aided design package and 
the corresponding design procedure. The design philosophy 
presented in this Chapter is most useful when a designer is 
able to characterize the desired system in terms of closed- 
loop eigenvalues and time response. Some initial physical 
insight of the weighting matrices ,their asymptotic proper- 
ties and the nature of the perturbation will be useful in 
the design process. This Chapter begins with a discussion 
of the various approaches to the LQ pole placement problem. 
The selected approach and the corresponding computer aided 
design package is presented. The design philosophy and 
S design procedure for both the reduced order and full order 
: model are then given. 


B. APPROACHES 


All the pole placement algorithms for LQ system that 
have been developed so far require an expression that relate 
the characteristic equation of the optimal system with the 
elements of the weighting matrices. Two such formulations 
for the stabilizeable and detectable time-invariant linear 
system (equation 2.1) and the quadratic criteria (equation 
2.3) are given by 


#(s)(-s) = o(s)#(-s)det{I + R'H(-s) QH(s)] (eqn 4.1) 


and 


32 


5 


Zoe SON Cc My LIP Te Mee ae, De Ie A eN rhe em he Se whGE Agree gem a Re kage hoe ta gem ae Spree NAL TES UR FRNA GRE EN ake 


#(s)#(-s) = $(s)$(-s)det(I+VpR2H'(-s)OH(s)R?] (eqn 4.2) 


where #(s) = det[sI -A +BF] and ¢(s) = det[sI - A] are 
the closed-loop and open-loop characteristic polynomials 
respectively. H(s) = C(sI-A)7' B is the open loop transfer 
matrix of the system. 

Both formulations have been used in root-locus’ type of 
procedure to investigate how the closed-loop poles move as 
weighting matrices changes [Refs. 5,6]. For MIMO case, 
there has been little success due to problems’ involving 
polynomial matrices. In this work, a different approach is 
adopted. Equation 4.1 or 4.2 is formulated as a numerical 
optimization problem in which the objective function is made 


equal to the determinant part of equation 4.1 or 4.2 


Obj = det{I + KH (s) Q H(s)] (eqn 4.3) 
or 
-i+ + a+ 
Obj = det[I + 1/,R*H (-s) QH(s)R "J (eqn 4.4) 
For a given desired closed loop pole s = Sy» equation 


4.3 or 4.4 becomes 
e (Sy ).(-Sg ) = 0 (eqn 4.5) 


Providing that ¢(sy)¢(-sy ) is not equal to zero, the 
objective function must equal to zero if the particular Q, R 
set is to correspond to the desired closed-loop poles. 
Convergence to zero for a given set of Q and R is therefor 
automatically guaranteed. 

The pole placement problem can therefore be solved as an 
unconstrained multivariable optimization in which the 


elements of Q and R are varied to make the objective 
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function in equation 4.3 and 4.4 approach zero. This was 
done during the early phase of the work. It was later 
discovered that more insight to the problem can be obtained 
by first transforming the problem to an appropriate coordi- 
nate system and then to perform pole placement one at a time 

This is of advantage as a system designer is often satis- 
fied with several open-loop poles in a large system. 
Reassigning poles in the the reduced-order model will reduce 
computer time and memory requirement. 

The optimization routine selected for this work is the 
so-called SUMT method (Sequential Unconstrainted 
Minimization Techniques ) obtained from the ADS package in 
[Refs. 20,21]. In this method, the objective function 
(eg. equation 4.3 or 4.4 ) and any constraint equation are 
formulated into an augmented objective function in which the 


problem is solved as an unconstraint optimization task. 


C. POLE PLACEMENT ALGORITHMS 


For ease of implementation and better insight, only the 
problem of determining the state weighting matrix Q (given 
R) that gives a set of closed-loop eigenvalues is consid- 
ered. It must be emphasised that the algorithm can also be 
formulated to determine R (for a given Q) or to vary Q and R 
at the same time. In most cases, the present formulation is 
adequate as designers usually have some knowledge about the 
control weighting matrix. System matrix that has real and 
distinct eigenvalues is presented first, follows by cases 


where A has complex eigenvalues and repeated eigenvalues. 


1. System with Real and Distinct Eigenvalues 


The original system given by equation 2.1 and 2.2 is 
first transformed into a diagonal form using the 


transformation given by; 


34 


x(t) = Mz(t) 


where M is an eigenvector matrix corresponding to the system 
matrix A. and z(t) is the new state vector. The trans- 
formed system in the new coordinate is given by, 


2 =I 
z(t) A z(t) + M Bu(t) (eqn 4.7) 
where A is a diagonal matrix dia[A,, A, ,4;,...] 


The performance index (equation 2.3), when expressed 
in terms of the new state vector z(t) becomes, 


a a x’Qx + u'Ru ) dt 


~oO 
J, (27M"QM z+ u’ Ru) dt 


wo a a 
a ( 27 Qz + u'Ru ) dt 


ee T 
where Q = M QM. 
It can be shown that to move an open-loop pole to 
its new location given by s,;= Sy » only Q, is required and 
other Qs' have no effect on the pole assignment. As an 


example, to move the open-loop’ pole at s =A, 
\= dial aA,, A 


a for 


2» A435 ++.) to its new location s=jX 
Aa ~ . . 
Q= diaf{0, q,, 0, ...] is required. 


m 


, » only 
Q can then be selected according to equation 4.3 or 


4.4 using the optimization routine. AS currently imple- 


mented in the program, there is no constraint equation 


A 
formulation. Once the value of Q that satisfies the desired 
pole location is obtained, the system is transformed back to 
the original coordinate system via, 


-TA «ff 


Q = M QM (eqn 4.9) 


With Q known, and R given, the optimal feedback gain F can 
be obtained by solving the steady state Riccati equation as 
given in equation 2.5 and 2.6 . Since the pole placement is 
done in the decoupled coordinate system, only the eigenva- 
lues that correspond to Q,is reasSigned; all other eigenva- 
lues remain unchange. It can be also shown that’ the 
eigenvector corresponding to an eigenvalue is also unchange, 
this property will be shown to be useful in the’ reduced 
order formulation of the linear quadratic problem. 

If desired, the problem here can also be formulated 
to move more than one eigenvalues in one run. This can be 
done by modifying the objective function to include more 


terms as follows; 


Obj = & det(I + R'H(-s)QH(s)R. ] (eqn 4.10) 


where n is the number of poles to be reassigned. 

The augmented matrix A,y,g = [A + BF] is then 
computed. If desired, the procedure may be repeated to move 
other open loop eigenvalue to its specified position using 
the new Agug as the starting plant matrix. This will in 
turn result in another set of Q andF . The effective Q, 


and F, after n reassignments are given by 


(eqn 4.11) 


(eqn 4.12) 


The above pole assignment procedure can also be applied to 
an optimal system where an initial starting Q and R are 
given. A good example is when the control system designer 
has some knowledge of the weighting matrix but would also 


like to meet a specific time response requirement. 
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2. System with Complex Eigenvalues 


If the same similarity transformation mentioned in 
the last section is used, the transformation matrix will be 
complex. To be able to work with real matrix, an auxiliary 


transformation of the form given by equation 4.13 is used; 


x(t) = Tz2(t) (eqn 4.13) 


T = ML and M is the eigenvector matrix (equation 4.6) The 


matrix L is given by, 


0.5 -0.5j 0.0 0.0 
0.5 0.5j O.O . : 
Ls 0.0 0.0 1.0 we 
: 1.0 
0.0 . 1.0 
_ 
: (eqn 4.14) 
‘ The transformed system is then given by, 
z(t) = \ Z(t) + T Bu(t) (eqn 4.15) 
with performance index , 
J = JS (trta Tz + u' Ru ) dt (eqn 4.16) 


A A 
where Q is now given by Q = ¢* QT. 
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It can be shown that to move a pair of complex 


eigenvalues given by s = a+ bj, a weighting matrix of the 


form 
0, 26 Osa O 
: % 
4 : 0 q. 0 
a t ' na 
Q > 0 0 oo re 
0 
0 0 


(eqn 4.17) 


with q: = die is required. 

In a similar manner, Q can be obtained by using the 
optimization routine, with the condition d; =q 4, formulated 
as a constrained equation. Inverse transformation and 
determination of Q, and F, are identical to the distinct 


eigenvalue case with M in equation 4.9 replaced by T. 
3. System With Repeated Eigenvalues 


In this case, the system matrix cannot be diagonal- 
ized but the general procedure given above still apply. The 


system is first transformed into the Jordan canonical form ; 
J=U AU (eqn 4.18) 


where U is a transformation matrix which is not the eigen- 
vector matrix M. An example of the Jordan form is given 


below, 


(eqn 4.19) 
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The only difference with the two procedures mentioned above 
is that the pole reassignment has’ to begin at the bottom of 
each Jordan block. For example, in the system given above 
(equation 4.19), the first re-assignment will result ina 


new system given by equation 4.20 


N 1 0 
J={0 N 
0 0 Sg 


(eqn 4.20) 


Determination of Q and F using the optimization and the 
inverse transformation routines are identical to the 


distinct eigenvalues case with M in equation 4.9 replaced by 
U. 


D. COMPUTER PROGRAM DESCRIPTION 


The computer aided design package developed in this 
thesis is illustrated in Figure 4.1 The program is devel- 
oped using the top-down approach with special purpose 
subroutines called by the main control program. The driver 
program supports three independent modes with the data entry 
portion common to all modes: 

1. Data Entry : The system matrices A, B, C and/or F, Q, 
R ete are entered through a data file. Design vari- 
ables such as desired poles locations, elements of 
matrices to be varied etc, are also specified through 
the input data file. 

2. Pole Placement Mode : In this mode, an arbitrary set 
of closed-loop eigenvalues is assigned by selecting 
the appropriate state weighting matrix. As shown in 


Figure 4.1, the transformation matrices for various 
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cases are computed first. The pole placement is 
achieved using the numerical optimization routine 
described in the last section; Q is obtained and then 
inverse-transformed to the original co-ordinate 
system. If desired, the results can be used as an 
input to the Linear Quadratic Control Program. 

3. Linear Quadratic Control Mode : This part of the 
program is adopted from the OPTSYS program. Given a 
set of weighting matrices Q and R and the’ system 
matrices A, B andC, it computes’ the steady state 
feedback gain F, closed-loop eigenvalues, etc. 

4. Singular Value Analysis Mode : This portion of the 
program allows the designer to analyze various 
designs obtained from the two modes mentioned above 
in term of singular value vs frequency plot. The 
main part of this program is adopted from [Ref. 22]. 

The three modes of operation mentioned above may be used 
in any order to implement specific design objectives. A 
typical design process will involve runs alternating between 
the three modes until a compromise between primary and 
secondary design objectives is achieved. Record of a 
typical design run together with a complete listing of the 
main program and their non-standard subroutine are given in 
Appendix B and C. 


E. DESIGN PHILOSOPHY 


The Linear Quadratic constant state feedback design 
philosophy for the linear time-invariant model is illus- 
trated in Figure 4.2. It assumes that the location of the 
eigenvalues and system time response are the main design 
objectives. These objectives can be achieved using the pole 
placement procedure developed in this thesis. Single or 


multiple reassignment can be made in one run. A number of 
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DATA ENTRY 


TRANSFORMATION __| EIGENVECTOR 
OF COORDINATE M,T,U ASSIGNMENT 


EIGENVALUES PLACEMENT 
COMPUTE Q, R, 


BACK- TRANSFORMATION 
TO ORIGINAL CO-ORDINATE {| 


COMPUTE FEEDBACK GAIN F 
(OPTSYS'S ROUTINE) 


ROBUSTNESS ANALYSIS 
SINGULAR VALUE PLOTS 


| TIME SIMULATION | 
POLE-ZERO MAPS ETC | 


Figure 4.1 Computer Aided Design Package Organization. 


ae designs can then be obtained using different starting 


control weighting matrices, different state weighting 
matrices and different assignment Sequences. Physical 
{ constraints such as control input amplitude, control input 


energy as well as general system properties such as asymp- 
totic behavior are heavily relied upon during this process. 


es € i 
1 4. , ., % a, . 


After the major objectives are satisfactorily achieved, 
secondary design objectives are considered. These include 
feedback gain reduction (by increasing the control weighting 
matrix), robustness (in terms of minimization of system 
sensitivity to modelling errors and/or parameter varia- 
tions), zeros locations, eigenvectors assignments. The 
extra degrees of freedom available in the MIMO state feed- 
: back system can often provide a means to improve these 
7 secondary objectives while only slightly modifying the 


closed-loop pole assignment and thus the time response. 
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EIGENVALUE AND TIME 
RESPONSE REQUIREMENTSS 


PHYSICAL ARGUMENTS, 


ASYMPTOTIC PROPERTIES 


POLE ASSIGNMENT AND/OR 
EIGENVECTOR ASSIGNMENT TO 
DETERMINE Qs AND Fs 


FEEDBACK ROBUSTNESS MODE TIME 
GAIN REDUCTION | SENSITIVITIES DECOUPLING RESPONSE 
REDUCTION EIGENVECTOR} |SIMULATION 


Figure 4.2 LQ Eigenvalue Assignment Philosophy. 


@ V. DESIGN EXAMPLES 


The design procedure described in Chapter 4 is illus- 


? 
Add dd, 


trated in this Chapter by two design problems. A typical LQ 
structure and its properties, together with the pole place- 
[ ment procedure is first presented with a 2x2 model. A prac- 
tical design problem is then presented for the highly 
coupled lateral channels of a CH-47 Helicopter. The 
resulting LQ designs are compared with other multivariable 
state feedback designs [Refs. 22,23]. It is shown that 
the procedure developed here is a viable tool for robust 
constant feedback controller design. 


i A. INTRODUCTORY 2X2 PROBLEM 


This problem formulated in reference 23 serves to demon- 
a strate how a highly cross-coupled multivariable control 
problem can be formulated and solved as a linear quadratic 
design problem, using the pole placement procedure. The 
problem provides excellent insight into the structure of the 
multivariable LQ system and its built-in robustness’ to 
cross-coupled perturbation. 
Figure 5.1 shows a diagram of this basic 2X2 system in 
which the plant is given by 


x(t) = Ax(t) + Bu(t) (eqn 5.1) 
y(t) = Cx(t) (eqn 5.2) 
where 


At 


Figure 5.1 A Simple 2X2 MIMO Model. 


This system has open-loop eigenvalue at -1l, -l and is 


therefore stable. The b,, term in the control matrix B is 
purposely made large to produce the cross-coupled effect 
from channel two to channel one( see Figure 5.1). The 
design requirement is to select a set of feedback gain F 
such that the closed-loop eigenvalues are at -2, -2. 
Assuming that this is the only requirement, it is not diffi- 


cult to see that a unity feedback law of the form (Figure 
5.2), 


es ; 7 


(eqn 5.3) 


will produce the desired closed-loop system given by, 


x, -2 50] |x, i 50 fe 


+ 


x, 0 -2 x 0 L 


C2 
L 


(eqn 5.4) 


The above design seems to be acceptable as far as eigen- 
values or time response is concerned. It is now shown that 


when robustness of the system is considered, the unity feed- 
back gain controller performs rather poorly. On_ the other 
hand, design using LQ Pole Placement type of formulation 
will result in robust controllers. To demonstrate the lack 
of robustness of the unity feedback design, the feedback 
gain matrix F as given in equation 5.4 is perturbed slightly 


(by +5%) and the eigenvalues of the resulting closed-loop 
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Figure 5.2 Unity Feedback for the 2X2 Model. 


system matrix are calculated. The absolute and percentage 
errors in the eigenvalue due to the perturbation of the 
closed-loop system are given in Table I 


It can be seen from the above that the first cut design 
is very susceptible to model and feedback perturbation. A 
5 % changes in the f,, term has resulted in a large shift 
( 160% ) in the closed-loop eigenvalue. Lack of robustness 
in the unity feedback design can also be seen in terms of 
the minimum singular value plot of the return difference 
matrix in the frequency domain. For the unity feedback gain 


system shown in Figure 5.2, the return difference matrix is 
given by, 
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TABLE I 


ee ee ne eee 


FE 


PERTURBED EIGENVALUE FOR 2X2 MODEL 


wssen en wnrenw ww nw em een ee ween eee we nw ee ewww twee ewe ewww wren wen ener ene 


Perturbation 
in F (+54) 


Absolute Changes 
in Eigenvalues 


warner nr een er wre ee ewe 


Percent Changes 
in Eigenvalues 


f,, and fo2 0.05 , 0.05  daoice Se Pt 
ie a) 0.0... 00. 0.0 ,0.0 | 
ea es (ae 0.67 , +3.265 | 33.5, 163.0 
Abe 1,255, 5.346 | 37.25. , 167.0 
» 
s+2/(s+1) 50/s+l 
I + G(s) = 
0 s+2/(s+1) | 
i 
(eqn 5.5) 


where G(s) =c(st-a) !B is the loop transfer matrix as indi- 
cated in Figure 5.3 


The multivariable Nyquist diagram { locus of det[{I+G(s)] 


for the system is shown in Figure 5.4 If this diagram is 
interpreted as for a single input system, the (-1/2,°) gain ~ 
margin and (+160) 


that the design is a good one 


phase margin would lead one to believe 
This has been shown to be 
a 5% perturbation in F would cause the system 
become unstable. The clearly demonstrate the 
the classical method in evaluating stability 


ve margin for MIMO system. . 


not the case, 


to above 


inadequacy of 


Robustness properties of the unity feedback controller 


Be will now be analyzed in terms of singular value as discussed 
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Figure 5.3 Loop Transfer Matrix - F = I. 


in Chapter 3. The minimum singular value plot of [{I+G(s)], 
is shown in Figure 5.5 as a function of frequency. The lack 
of robustness is clearly indicated by the relative small 
Singular value at frequency around 2 rad/s. Using the 
universal phase and gain margin chart developed in 
(Ref. 19], the minimum singular value at this frequency 
corresponds to a gain margin of (0.91, 1.0) and a phase 
margin of (+ 4 deg). 

It is now shown that formulation using LQ approach and 
the pole placement procedure developed here will result in 
robust design that meet the time response requirement. 
Furthermore, better insight of the design process can be 
obtained from the procedure to be described here. The first 


step in the LQ design is to determine the asymptotic 
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Figure 5.4 Multivariable Nyquist Plot. 


properties of tle system, i.e. movement of closed-loop poles 
as R70. Using results from Chapter 2, it can be estab- 
lished that as R increase from 0 too, both closed-loop 
poles move from infinity on the real axis to the open-loop 
poles location. None of the closed-loop poles stay finite 


as R»20O since the dimension of the input control vector is 


equal to the dimension of the state. Assuming that R = I, 
the pole placement is accomplished in two steps. The first 
step is to move the open-loop pole at -l to -2.0. As the 


System matrix A given is already in Jordan form, no trans- 


formation is required. The pole placement program puts the 
pole at -1.9987 with, 
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Singular Value Plots - Unity Feedback. 
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0.00119 


0.01983 


1.9915 


Agug 
0.01983 


In the second step, the other open-loop pole at -l. is 
moved to -2.0 , using Agug as the new plant matrix. The 


resulting Q and F and the augmented plant matrix become, 


-2.998 -149.9 0.9994 $49.9:78 


-149.9 7499.3 -0.00841 0.4211 


The effective Q, and Fe required to move’ both open- 


loop poles at -1.0 to -2. are Q, =Q, + Q, and Fe, = F, + 
F, as shown in equation 5.6 below. The pole placement 
procedure is completed with the final eigenvalues placed at 


(=1,.99255., 


+j0.05628). 


2.99919 0.9994 -49.978 


-149.9 0.0114 0.4211 


(eqn 5.6) 
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The singular value plots of the case where R = I 
together with the unity feedback gain ( non-LQ design ) are 
shown in Figure 5.6 The well established fact that LQ 
design possesses ( 1/2,” ) gain margin and (#60deg) phase 
margin can also be readily observed from the same figure as 
the minimum singular values of [I+G], 2% , is greater than 
one for all frequency. Changes in closed-loop eigenvalue 
for a small perturbation in F is again computed as shown in 
Table II . It can be seen that the LQ design is robust with 
the largest percentage change in eigenvalues location of 
only 10%, when compared with the 160% change in the unity 
feedback design. 


TABLE II 
PERTURBED EIGENVALUE FOR LQ DESIGN 


nm err er ew wm em eo em mew wm em em em em em ew wwe ew we www ewe ew wee we me ew were ew ere ee ee. 


Perturbation Absolute Changes Percent Changes 

in F (+5%) in Eigenvalues in Eigenvalues 
fic, and fay 1 | 0.2169 02142. | 10.7 2k 
oy Gees oe O119 {0.119 ea ee 
Cae ees 0.0592, 0.0578 | 2.90, 2.89 
pee "| een 0.07, 0.070 | 552 4 8152, 


The pole-zero plots of various closed-loop transfer 
functions of the closed-loop transfer matrix for both the 
unity feedback and LQ design are compared in Figure 5.7 and 
5.8. For the unity feedback design, zero at minus three 


for the input 2 to output 1 channel corresponds to the 
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Figure 5.6 Comparison-Singular Value Plots (2x2 model). 


minimum singular value frequency ( point A in Figure 5.6). 
It is in fact this zero that causes the the system _ to be 
sensitive to perturbation. For the LQ design, the built in 
robustness cause the zero at minus three to move toward the 
pole location at -2. 

Improvement in the robustness from LQ design is now 
analyzed in terms of Bode plots. The open-loop gain and 
phase vs frequency plots for a MIMO system can be obtained 
from the open-loop transfer function matrix, G(s). For full 
state feedback, G(s\2e(st-Ay B. (if the open-loop plots 
without feedback is considered, G(s)=C(sI-A) 'B ) The 
matrix Gis amatrix-valued rational function of s, it 
describes how the system (with or w/o feedback) appears to 
its environment. It is an external description of the 
system and is closely related to the zeros of the system. 
The open-loop Bode plots for the two designs are compared in 
Figures 5.9 to 5.11 As ba, 70, there is no coupling from 
channel 1 to channel 2. All channels have a -20 dB/decade 
slope at high frequency which is in agreement with earlier 
observation that each channels has' one finite zero. It is 
interesting to note that the unity feedback and LQ design 
result in almost identical gain vs frequency plots for 
direct channels (i.e. channel 1-1 and 2-2). Any classical 
single loop type of analysis will not be able to detect any 
difference between the two designs. On the other hand, 
cross-coupling effect can be readily seen from the gain vs 
frequency plot in channel 2-1 (Figure 5.10). The unity 
feedback design is characterized by the rather large channel 
2-1 gain at low frequency. A very small perturbation in 
channel one's parameter can change the system behavior 
considerably. This has been illustrated earlier by 
perturbing the feedback gain. It can be seen from the 


figure that LQ design reduces the crossfeed gain by large 
amount. 
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Figure 5.7 Closed-Loop Pole-Zero Plots (Unity Gain FB). 
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Closed-Loop Pole-Zero Plots (LQ Design). 
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Figure 5.9 Open-Loop Bode Plots Channel 1-1. 
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Figure 5.10 Open-Loop Bode Plots Channel 2-1. 
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B. A HELICOPTER DESIGN PROBLEM 


The design procedure described in Chapter 4 is further 

- illustrated in this section by an actual design problem. A 

controller is designed using the Linear Quadratic Pole 

Placement approach for the lateral dynamic model of a CH-47 

§ helicopter. The resulting design is then compared to multi- 
variable state feedback controller given in [Ref. 23]. 


oa 


The highly coupled two inputs lateral axis model of the 
CH-47 helicopter is used as a full order system. The state 


vector x(t) and control input vector u(t) are given by, 


x, = v = Y-axis velocity (ft/sec) 

X2 = p = Roll rate (rad/sec) 

xX; = r = Yaw rate (rad/sec) 

X4 = ¢ = Roll angle (rad) 

u, = 65 = Yaw rate rotor deflection control (inches. ) 


uy =8¢ = Roll rate rotor deflection control (inches. ) 


The state variables and the body axes of the aircraft are 
illustrated in Figure 5.12 The yaw and roll rotor deflec- 
tion control produce changes in the yaw rate, Slide slip 
angle, roll rate and bank angle. Assuming full state feed- 
back, the A, B, and C system matrices are given by, 


C -2.27 1.420 -0.15 31.99 
A = -O1 -0.7 -0.07 0.0 : 

; 0.04 -0.05 -0.05 0. 
QO. 1. 0.11 0. 

- 0.12 0.95 1 0 0 0 

B= 0.04 a Og s c =/0 l 0 0 

34 020 0 0 1 0 

0.0 0 | 0 0 0 l 
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Figure 5.12 State Variables and Body Axes for CH-47. 


62 


“. ee Pi » 


The open loop eigenvalues of this system are; 


s, +0.2065 
-0.0503 
-1.0498 
-2.1263 


open-loop system is not stable and the time response 
is shown in Figure 5.13 for zero input and an initial condi- 
tion of ¢(Q )=0.1 rad 
The design requirements are to satisfy specification in 
terms of the step input response of the roll attitude 
channel ( ¢/¢, ). Stability margin requirements are those 
given by standard military specification. In [Ref. 23] 
three designs were obtained to satisfy the desired time 
response performance specification. All three control laws 
are of the form given by, 


u(t) = -Fx(t) + h¢ (t) (eqn 5.7) 


The values of F and h are summaried in Table III. It was 
shown in [Ref. 23] that two of the designs (design 1 and 2 ) 
were extremely sensitive to model errors and perturbations. 
It is now shown that LQ formulation using the pole placement 
procedure developed here will result in robustness design 
and yet satisfy the conventional time response criteria. 

It is assumed that the closed-loop poles requirement are 
the same as those obtained in the AlphaTech's design 1. 
(-25.12, -12.51, -9.652, -2.125). The first step in the 
design is to establish some asymptotic properties of the 
System. The dimension of the control input (2) is less than 
the dimension of the state(4). As shown in Chapter 2, this 
implies that at least two closed-loop poles approach minus 
infinity in the complex plane when R-  0O. When R70 


(meaning no control input allowed), the closed-loop poles 
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Figure 5.13 Open Loop Time Response  ¢(0) = 0.1 rad. 
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TABLE III 
ALPHATECH DESIGNS ( 1, 2, AND 3) 


approach the open-loop poles or their mirror images if they 
are in the right hand plane. (i.e. -0.2065, -0.0503, 
-1.04987, and -2.12635). 

The next step in the design procedure is to select a 
Suitable starting control weighting matrix. Based on guide- 


line given in [Ref. 4] and assuming that u,,,, and u,,,, are 


equal to l inch. R= I is selected for the initial design. 
(In the present formulation p is not needed as only Q is 
varied to place the pole ). 

The sequence of the reassignment is determined next. At 
present there is no known established guideline for 
selecting the prefered sequence of moving the poles. Two 
extreme Sequences are considered as follows, 

A. Move the left most open-loop pole to the left most 
desired closed-loop pole etc. The reassignment 


sequence then become: 


1. move pole at -2.1265 to -25.12 
2. move pole at -1.0483 to -12.51 
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3. move pole at -0.2065 to -9.652 
4. move pole at -0.0503 to -2.125 


Move the right most open-loop pole to the left most 
desired closed-loop pole etc. For the problem given, 


the reassignment sequence are 


move pole at +0.2065 to -25.12 
move pole at -0.0503 to -12.51 
move pole at -1.0498 to -9.652 
move pole at -2.126 to -2.125 
(close, so no move required) 

Using the pole placement program developed in this 
thesis, the corresponding Q and F for each of the reassign- 
ments are obtained and tabulated in Tables IV and V for the 
two cases selected (design LQ-A and LQ-B). It can be seen 
from the table that difference reassignment sequence results 
in different set of Q, and Fe. In general, once the 
matrix R and the n closed-loop poles are selected, there are 
n(n+1l)/2 extra degrees of freedom available in Q. This also 
verifies the well-known fact that the general solutions of Q 
and R for a given set of closed-loop eigenvalue are non- 
unique. The elements of the Q matrix obtained during each 
reassignment depends on the transformation matrix (M, Lor 
U) and hence the eigenvectors that are used to construct 
them. The important of eigenvector type of assignment is 
evident as Q, F and the resulting closed-loop poles depend 
on the eigenvectors used. The designer can shape the 
design by choosing appropriate eigenvectors for the trans- 


formation matrix. The application of these extra degrees of 


freedom will be discussed in the following section. The 


resulting designs (LQ-A and LQ-B) are now compared with the 
first design in [Ref. 23]. 
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TABLE V 
RESULTS FROM POLE PLACEMENT SEQUENCE(LQ-B) 
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the yaw rate response; the yaw rate response is well damped. 
The LQ-B design appears to be a better design as coupling 
among modes are small and can not be detected from the time 
response plot. It is noted that the difference in response 
for the same set of closed-loop eigenvalue is due to 
coupling among various modes through their respective eigen- 
vectors. The 'overshoot' in this case is obviously not due 
to complex conjugate poles as all closed-loop poles in the 
three designs are on the real axis. The set of final eigen- 
vector for the three designs are tabulated in Table VI 

Inter-mode coupling for the yaw rate response in the 
AlphaTech design and roll attitude response in the LQ design 
case A can be readily seen from the table. The issue of 


eigenvector assignment will be discussed in the next 


section. 
TABLE VI 
CLOSED-LOOP EIGENVECTORS 

fi etige eee ee Eigenvalues/Eigenvector ——*&|: 
-24.79907 -2.12242 -9.72403 -11.9449 
Alpha] -0.39336 -0.99976 -0.48016 -0.41854 
one 0.10767 0.00822 -0.32948 -0.33640 
-0.91306 0.01955 -0.81181 -0.84283 
-0.00029 -0.00488 0.04306 0.03593 
! -2.12499 -9.26645 -12.52066 -25.20990 
LQ-A 0.22870 -0.15459 0.01894 -0.12653 
0.18018 -0.98218 -0.99664 0.99118 
-0.95603 -0.01258 0.00396 0.00031 
-0.03529 0.10614 0.07964 -0.03932 
-25.17894 -9.62708 -12.51644 -2.12630 
LQ-B -0.12652 -0.13209 0.05042 -0.99977 
Q 0.99118 -0.98557 -0.99375 0.00797 
0.00024 -0.02568 0.06075 0.01945 
-0.03937 0.10267 0.07886 -0.00475 


69 


CLOSED~LOOP RESPONSE ALPHATEC 1 
STEP INPUT IN ROLL ANGLE 0.1 RAD 


0.06 
YAW RATE 
0.4 


0.05 


Aa 
< 
4 
I 
fad 
wal 
o 
a 
< 
oa] 
J 
° 
io] 


ND 
T/S 


O XAW RATE 
A ROLL ANGLE=RAD | 


1.0 
TIME -— SEC 


Figure 5.14 Closed-Loop Time Response Plot (AlphaTech 1). 
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Figure 5.15 Closed-Loop Time Response Plot (LQ-A). 
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Closed-Loop Time Response Plot (LQ-B). 
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The difference in time response performance for the 
three designs can also be interpreted in term of the closed- 
loop pole-zero plots in the frequency domain. The pole-zero 
plots for the designs, with $e as the input, are shown in 
Figures 5.17 to 5.19 . As all pole locations are the same 
for the three designs, they are indicated only once in each 
diagram. 


In the AlphaTech's design, the zero locations for the 
various channels clearly indicate the weakness in the 
design. Most transmissions zeros are located away from the 
poles locations. The system is therefore strongly coupled 
to its external environment. A good example is the lightly 
"damped" pair of zero at (-1.05,+7.31j) for the v-¢chan- 
nels. It is in fact these undesired zeros that reduce the 
overall robustness of the system. The mechanism of robust- 
ness improvement in the LQ design can also be seen in the 
pole-zero plots in Figures 5.18 and 5.19 The built-in 
robustness in the LQ design causes the zeros at various 
channels to move to locations where their transmission prop- 
erties can be canceled by the closed-loop poles. An excel- 
lent example is in the v- ¢ channel, where the zeros at -2, 
-7, and the mirror image of +24.0 are fairly close to the 
closed-loop pole locations at -2.12, -9.26 and -25.12. In 
the case where the zero from LQ design are not close to the 


closed-loop poles (r- ¢ channel for LQ-A ) the zeros are 


¢c 
"well damped" and their transmission properties can be 


neglected. 


Robustness properties of the three designs presented 
here can also be analyzed from the open-loop’ Bode plots. 
The open-loop transfer function gain plots for channel 1-1, 
1-2, 2-1 and 2-2 for the three designs are shown in Figures 
5.20 to 5.24 Cross coupling problem for the AlphaTech 
design is clearly indicated by the relatively high gain of 
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Figure 5.18 Closed-Loop Pole-Zero Plots (LQ-A). 
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Figure 5.19 Closed-Loop Pole-Zero Plots (LQ-B). 
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the channel from input 2 to input 1 (2-1). Both LQ designs 
presented here reduced the gain in this channel by more than 
40 dB inthe frequencies of interest. The bandwidth is 
reduced from above 100 rad/s to about 8 rad/s. Unlike the 
- simple (2x2) system where there was little difference 
z between the direct channels of the two designs, gain adjust- 
‘ ment is observed in all channels. For example, LQ designs 
reduce the gain in channel 1-1 but increase the gain in 
channel 2-2. There is also a slight increase in the 
coupling channel 1-2. The overall effect is that of gain 
balancing, gains in channels that are affected by cross- 
coupling perturbation are lowered together with some adjust- 
ments in other channels. Different reassignment sequence 
results in different adjustments. The designer has’ to 
choose a set of gain curve depending on the particular 
requirement. The relationship between the open-loop Bode 
plots and the zeros of the system is also evident from these 
diagrams. The low frequency resonance (or ‘peak') in the 
gain vs frequency plot for the AlphaTech design correspond 
to the undesirable zero mentioned earlier. In the LQ 
designs, these low frequency resonances are absent because 
of the more desirable zero locations. It is also inter- 
esting to note that the LQ-B gain curves fall nicely in 
between the other two designs. This fact, together with its 


better overall low frequency gain characteristic, may 
account for the better time response behavior of the LQ-B ~ 
design. 

As a final comparison, the closed-loop frequency 
response plots of the various channel for the three designs 
are shown in Figures 5.25 to 5.32 . At high frequency, all 
the gain plots approach the -20dB/decade slope as all eigen- 
values are on the real axis. The AlphaTech design has a 


near Odb gain for frequency up to about 2 rad/s. It appears 


a 
fea 
— | 
O 
* c=] 
z Q 
ee | 
f= 
a 
—_ 
= 
— 
ra 
O 
=< 
= 
cir a TT 
10 10 


a) 


igure 5.20 Bode Piots Comparison- Input 1-1. 


78 


Wrers 


Pe et iad al 


op a oe, OMe 


LS 


wT 
4 


MAGNITUDE — DECIBI 


— >, 
ND 


oy ck Se ee ee NS SD 
O: rary Oke r ALIN tO 


60.0 


a ee Or en i See Ce ee oer ay 


10. «10 
FREQUENCY (RAD/S) 


1 Bode Plots Comparison - Input 1-2. 


79 


WR. Sete eee Sk SE SV a CLAUSE OTs Siete, Bie hart a She ST OR ie eg eta SKU Aig ergs 


aaa ias ila e ee 


10 


Wy, 
XN 


Won ee 


we 
‘ 


10° 
80 


iN 
NI 
Bode Plots Comparison - Input 2-1. 


10" 


e 
a) 
< 
& 
> 
AG Ss 
Zz 
i 
— 
oe 
es 
aa 
[x 


Figure 5.22 


STMaPaAd — cd OLINOVIN 


a eS en ee a, | er ck, «=| \ are aioe 
as a  )=3=63[2Llm ee 3 lS i ee 38 eee 3 ry is 


aaa, 


~~ yr Ohl _ =~ = 


2 an Sem el : 7 INS ft : mh 
OP SIN oe euros a ~ ~ 


100 


LS 


DECIBE 


4 _ 


40 


4 


20 


MAGNITUDI 


“lo ae dah 
FREQUENCY (RAD/S) 


Figure 5.23 Bode Plots Comparison - Input 2-2. 


81 


aoe ew ie Ca eg: 
a ae Ce CM ee ee a Oe as WS wg Se ee ae Se ae Cae aS ies Bee Be ae a age eh ae 


to be an acceptable design but was shown to have undesired 
transmission zeros in other channels; this can also be seen 
from the closed-loop plot for the r-¢. channel in Figure 
5.31 . Design LQ-A, obtained from the reassignment sequence 
A, is characterized by very low DC gain (-9dB) and 'peak' in 
. frequencies near 10 rad/s. These have been shown, both in 
the time response and pole-zero discussions that it will 
have undesired effect on the pilot's control. Design LQ-B, 
obtained from the second reassignment sequence appears to be 
the best compromise. All channels (Figures 5.30 to 5.32) 
have flat low frequency characteristic and coupling between 


modes are almost absent. 


C. DISCUSSION AND CONCLUDING REMARKS 


A new computer aided design procedure for the multivari- 
able linear time-invariant system using Linear Quadratic 
Pole Placement formulation is. presented. The two design 
examples presented above have served to demonstrate the 
complexity involved in a multivariable design. The main 
problem lies in the fact that the solution of a MIMO problem 
is in general non-unique. This was shown in the helicopter 
problem where different approaches result in different 
designs, although the closed-loop eigenvalues for all 
designs were the same. It was also shown that the extra 
degrees of freedom in MIMO system design can be accounted 
for by analyzing the singular value plots, transmission zero 
movements and closed-loop eigenvectors of the designs. It 
becomes apparent that the success of any multivariable 
design methodology hinges on how to make use of these extra 
degrees of freedom available in MIMO system. It was also 
shown in the above design examples that the Linear Quadratic 
Pole Placement procedures possess such quality. Some unique 


properties of the method presented here are as follows; 
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Figure 5.24 Closed-Loop Bode Plot- AlphaTech 1-1. 
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Figure 5.26 Closed-Loop Bode Plot- AlphaTech 1-4. 
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a Figure 5.27 Closed-Loop Bode Plot- LQ-A 1-1. 
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Figure 5.29 Closed-Loop Bode Plot- LQ-A 1-4. 
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Figure 5.30 Closed-Loop Bode Plot- LQ-B 1-1. 


89 


INPUT g= 1 
OUTPUT g= 3 


CLOSED-LOOP BODE PLOT ( © - TF GAIN = 1.632°10 


n 
| 
<3) 
ice} 
— 
{S) 
{<> 
i=} 
t 
tf . 
On 
~ 
S 
z 
io) 
< 
= 


iv 10 
FREQUENCY — RADIANS PER SECOND 


Figure 5.31 Closed-Loop Bode Plot- LQ-B 1-3. 
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1. 


It guarantees stability automatically. 

It has partly overcome the main difficulty in 
applying optimal control theory to practical  prob- 
lems; i.e. that of selecting suitable performance 
indices (Q and R matrices). The designer can now 
choose to compute Q (if he knows somethings about R) 
or vice versa or compute both Q and R if both of them 
are unknown. 

It has built-in robustness to model's error and 
perturbation. 

Reduced-order type of problem formulation is possible 
as the procedure can reassign poles one at a time 
without affecting others. 

the other hand, the design procedure developed here 


without some shortcomings. Three main problem areas 


are described below, one of which can be overcome by addi- 


programming efforts while the others are still active 


research areas pursued by many researchers. 


Eigenvectors Assignments: It was shown in the design 
examples presented above that while the overall speed 
of response of the closed-loop system is determined 
by its eigenvalues, the 'shape’ of the transient 
response depends on the closed-loop eigenvectors. 


The problem of eigenvectors assignments was’ first 


formulated in [Ref. 16]. Since then many eigenvec- 
tors assignment algorithms have been developed 
[Refs. 17,24] for use in multivariable design. In 


principle, the eigenvectors assignment routine can be 
incorporated into the coordinate transformation 
portion of the OPTPP program (as indicated in Figure 
4.1 in Chapter 4). In essence, a new similarity 
transformation different from M in Equation 4.6 is 
computed once the eigenvalues and eigenvec_ors are 


specified. AS most eigenvector algorithms available 
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at present are iterative in nature and their inclu- 
sion requires major programing efforts, it is recom- 
manded for future work. 

2. Perturbation or Model's Error Structure: The guaran- 
teed robustness obtained from the LQ formulation 
given by equations 3.4 and 3.5 ensures that the 
perturbation or model's error (L(jw)) is sufficiently 
small so that the closed-loop system remains stable. 
However, the above only applies to simple model's 
error structure where both L(jw) and R are diagonal 
matrices. There may be cases when the above equa- 
tions do not hold and hence the design becomes very 
conservative. An example of this nature is shown in 
[Ref. 19]. An ad hoc solution is to use non-diagonal 
control weighting matrix as mentioned in Chapter 4. 
Two designs for the helicopter problem are obtained 
using non-diagonal R. Their results in terms of 
singular value plots, Bode plots etc are compared 
with other designs in Appendix A 

3. Reassignment Sequence: As shown in the last section, 
different reassignment sequences result in different 
designs. At present there are no known methods for 


determining the best reassignment Sequences. 
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VI. CONCLUSIONS 


It was demonstrated that the general pole assignment 
problem in multivariable state feedback control system 
design can be formulated using the Linear Quadratic Control 
approach. This method of formulation is effective for two 
main reasons; First, the extra degrees of freedom available 
in a multivariable system structure is utilized to produce 
designs that are robust to perturbations in the system and 
gain matrices. Secondly, the classical difficulty of 
selecting suitable performance index in optimal control 
formulation was partly overcome, as designers now have the 
flexibility of specifying only Q (the state weighting 
matrix) or R (the control weighting matrix) or both Q and R 
as the design parameters to be varied. In other words, 
knowledge of the performance index which ideally should come 
from physical argument is used to the best of designer's 
advantage. In addition, the structure of the present formu- 
lation is such that eigenvector assignment can be further 
incorporated into the procedure. The above properties, when 
combined with the reduced-order formulation capability, have 
been shown to be very versatile and have important impact on 
the performance of the resulting design. 

The optimal pole placement (OPTPP) program developed 
here is combined with other well established routines to 
form a computer aided design and synthesis package. 
Together with the design procedure and philosophy presented 
here, it provides the control system designer an excellent 
and viable tool to solve complex multivariable problems. 

The procedure was applied to practical test examples, 
and numerical results were presented and discussed. Results 


indicated that all controllers obtained from the formulation 


94 


given here were stable and robust. Introducing perturbation 
in the system matrices leaded only to small errors in the 
assigned poles. The main shortcoming of the design proce- 
dure is the ad hoc nature in which the poles are reassigned. 
More research is required to develop a systematic way of 
assigning poles and its eigenvectors thus allowing the 


designer to optimaly shape the response of the system. 
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APPENDIX A 
NON-DIAGONAL R DESIGNS 


- The two design examples presented in Chapter 5 were 
based on diagonal control weighting matrix (i.e. R= I). It 


is now illustrated that design using non-diagonal R_ will 


provide yet another degrees of freedom available to the 
designer. This type of formulation is especially useful 
when the model's or error structure is known. For multipli- 
cative type of perturbation, the effect of control weighting 
matrix on the system stability has been explored in 
[Ref. 12]. In essence, the selection of the R matrix deter- 
mines the coordinate frame in which the sensitivity assess- 
ment is to be made. This can be readily seen from equation 
3.1, the general form in which R is non-diagonal is given 


below; 


SiR Co (OR Hoe Se Ce) (eqn A.1) 


In general, the sensitivity of the system to perturba- 
ie tion ina particular L(s)'s direction can be reduced by 
; making o rr o-! (s)R 2 - I] small. This can be done 
simply by choosing an appropriate R. The main problem with 
this kind of approach is that L(s) must. be known precisly 
for all frequency for the computation of @ [R'@L7' (s)R™? - 
ni In addition, the worst case direction of L(s) must be 
known otherwise the resulting design may be too 
conservative. 


The helicopter problem presented in Chapter 5 is now 


analyzed using the non-diagonal control weighting matrix. 


Two designs are obtained as follows; 
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Design LQ-C is obtained using an assignment sequence 

Similar to LQ-A with no off-diagonal element in R. Design 

LQ-D is obtained using placement sequence for design LQ-B 

but has off-diagonal element in R. Q and F obtained during 

2 each move and the final Q, and F, are tabulated in Tables 

VII and VIII. Singular value plots and the open-loop Bode 
Plots are compared with other designs in Figures A.1l to A.5 

Both design has singular value greater than one for all 
frequency. It is interesting to note that similar reassign- 
ment sequence produce similar singular value plots. This 
can be readily seen by comparing LQ-A with LQ-C and LQ-B 
with LQ-D in the figures. The effect of using non-diagonal 
R merely changes the shape of the singular value plots. For 
the cases presented here, both non-diagonal R designs are 
Slightly less conservative (having lower singular value). 

As in the singular value plots, the shape of the open- 
loop Bode plots (with feedback) are closely related to the 
reassignment sequence.(compare Bode plots of LQ-A with LQ-C 
and LQ-B with LQ-D in Figures A.2 to A.5 . Results from 
pole-zero maps also indicate similar trends. 

Ii. summary, it is demonstrated that designs using non- 
diagonal control weighting matrix (including possibly off- 


diagonal elements) provide yet another means of ‘'fine 


97 


re Seas Rend s PRNR REA CS Rita, CSET Se Se ‘ee Jee 3. “oye fy 


ee = = + soe ., mikes, . . - % rt 
I ee a ee ae ac ed eC a SE a Rae en Dh gn Sie eT aS a 
ee a ig oa . « . Be ngs A . . e+ “J 


ote Kee e ts 


tuning’ the design. This capability, such as using the off- 
diagonal elements directly in design, is unique to the 


present formulation. Robustness between the upper and lower 
crossfeed (of L(s)) can be controlled by adjusting the rela- 
tive weighting of the upper and lower (or off-diagonal ) 
elements of the control weighting matrix. It must be empha- 
sized that this kind of fine tuning is only possible for a 
class of rather well-defined structure of L. In practices, 
other constraints, such as the energy of the control input, 
the conditioning of R etc must’ be considered over the range 
of frequencies. The key issue of model's error structure 
and how it can be used in multivariable control system 


design is currently being investigated by many researchers. 
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TABLE VII 
RESULTS FROM POLE PLACEMENT SEQUENCE (LQ-C) 
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TABLE VIIT 
RESULTS FROM POLE PLACEMENT SEQUENCE (LQ-D) 


www ween ewe ee wen ewe een eee ee ewe ee eww we eet ewer ere reer errr rater 


Q and F obtained during each reassignment 


—_—— 


Move 


ee 


—_ ee 0 


' 
AWN 1 ACON 
RO tr muameanl 
Ot 1 OIOMO 
OM IMANHEN 
mm eescolme 

eet at rit 


Os 1 AIRDWO 
MNO 1 —Oonr 
ew 1 CoOciw 
Qo 1 sow 


Two rhoroel 
eo eh et we ew 
foNloN onl talc oc) 
Nest pean 
1 fomlen) 
1 ' 

_—" 

' 
SF 1 OTN 
DO 1M MMS 
OWT § COMIN 
OT VTOINS 
WWM FADS 

eet oe 

Wo reneaswy 
rt mC 
oo rINGS 

f] 

’ 

' 


ee ee eo8 


Oo 1Onrtna 


LON POTS 


.27600 
.89901 
-9.95601 
30.55365 


-0 


7 


Zeiss? 
- 30.9249 


h 


u(t)= - Fx(t) + h o (t)s 


100 


SINGULAR VALUE 


et 
FREQUENCY (RAD/S) 


Figure A.l Singular Value Plots - Comparison. 
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Figure A.2 Bode Plots Comparison- Input 1-1. 
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Figure A.3 Bode Plots Comparison - Input 1-2. 
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Figure A.4 Bode Plots Comparison - Input 2-1. 
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Figure A.5 Bode Plots Comparison - Input 2-2. 
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